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Detailed Action 
Response to Amendment dated 2/13/2007 

1 . Claims 1 0-25 are presented for examination. 

Response to Arguments 

2. Applicant's arguments with respect to claims 10-25 have been considered but are moot in view of 
the new ground(s) of rejection. New ground(s) of rejection are necessitated by Applicant's amendments. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 
rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

4. Claims 10, 12, 15, 17-19, 21, and 24 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Abrahams US Publication #2002/0120934 (Abrahams hereinafter), in view of Zernik et al. US 
Publication #2002/0038299 (Zernik hereinafter). 

5. As per claims 10, 17, and 19, Abrahams teaches substantially the invention as claimed including a 
method and system for providing information across a computer network, Abraham's teachings 
comprising: 

an information registering device which includes a positioning device and a sending unit, said 
positioning device indicating a desired object in said displayed image, and said sending unit sending a 
first identification information containing an object information relevant to said indicated desired object, a 
first keyword information and a first reference information relevant to said content rendered by media to 
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said computer network (fig. 3-4; Paragraphs 0058-0061. Generate program selection information and 
determine selectable objects in the program or scene. Paragraphs 0047-0048. Selection information 
includes keyword, identification and reference.); 

an information viewing device that displays an image of content rendered by said media and 
sends object selection information (Paragraph 0046. Viewer sees object of interest.); and 

a database that links said first identification information, said first keyword information and said 
first reference information received from said information registering device through said computer 
network, and stores said linked information (Paragraphs 0056; 0058. Database can be external device and 
accessed by a web server, figs. 3-5; Paragraphs 0048-0050; 0055. Program selection information is 
similar to selection information, and stored in a database. Program selection information that comprises 
identification (counter, coordinates), keywords ("sony walkman"), and reference information (url links)); 

wherein database performs a first matching process to match said first keyword information from 
said information registering device and object selection from said information viewing device; and sends 
at least one of said first identification information and said first reference information linked to said first 
keyword information according to the result of said first matching process to said computer network 
(Paragraph 0025. Database for storing related content. Paragraphs 0049-0050; 0053; 0062. Identify and 
match selected pbject. Display program selection information and related links to viewer.); and 

said information viewing device displays said at least one of said first identification information 
and said first reference information from said database (Paragraphs 0049-0050; 0053. Display selection 
information and related links.). 

6. Abrahams teaches substantial features of the claimed invention including program selection 
information comprising a set of information including "program name" and additional information related 
to the selection information such as "Sony Walkman", i.e. examples of first keyword information; and 
Abrahams teaches of a person or producer determining program selection information and identifying 
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objects in a video program (Paragraphs 0059-0061). However, Abrahams does not specifically teach of a 
first keyword information entered by a user; and an information registering device which displays an 
image of content rendered by a media. 

It would have been obvious to one of ordinary skill in the art that the person or producer (user) 
taught by Abrahams can enter the first keyword information, i.e. "program name 5 ' or "Sony Walkman" in 
the database, which would allow the person or producer to customize and provide unique information for 
display to the viewer, and use the information for matching with other information in the program 
selection information. Furthermore, since a person can identify objects in a video program, i.e. content, it 
would have been obvious to one of ordinary skill in the art to display an image of the content to visually 
identify objects of the video program and determine coordinates for the objects. 

7. Abrahams also does not specifically teach of sending a second keyword information entered by 
another user to said computer network, and matching the first and second keyword information. 

Zernik teaches of an interactive television system, wherein a viewer can enter search query in the 
form of text (second keyword information) to the Internet (computer network) (Paragraphs 0040; 0076) 
and match the; query to keywords on a web page (Paragraph 0063). 

8. It would have been obvious to one of ordinary skill in the art at the time the invention was made 
to combine the teachings of Abrahams and Zernik for the viewer to enter a search query, send the search 
query to the Internet, and match the query to keywords, which would allow the viewer to conveniently 
retrieve additional information regarding a program (Paragraph 0076). 

9. As per claim 18, Abrahams teaches substantially the invention as claimed including a method for 
providing information across a computer network, Abraham's teaching comprising: 
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displaying an image of content rendered by a media (Paragraph 0046. Viewer sees object of 
interest.); 

making inquiry a media information regarding to said displayed image of content of said media to 
an information search device that is connected to said computer network (Paragraph 0046. Select object 
of interest.); 

receiving and displaying a keyword information regarding to said media information searched by 
said information search device (fig. 3; Paragraphs 0049-0050. Display link with object); 

sending an identification information containing an object information relevant to a desired object 
indicated from said displayed image, a first keyword information selected in said displayed keyword 
information and a reference information relevant to said content rendered by media through said computer 
network (figs. 3-5; Paragraphs 0048-0050; 0055. Program selection information is similar to selection 
information, and stored in a database. Program selection information that comprises identification 
(counter, coordinates), keywords ("sony walkman"), and reference information (url links)); 

linking said sent identification information, said first keyword information and said reference 
information in said information search device (Paragraphs 0047-0050; 0055. Object is identified with 
keyword, identification, and reference information); 

storing said linked information in information search device (Paragraphs 0025; 0048; 0055. 
Database for storing related content. Paragraphs 0056; 0058. Database can be external device and 
accessed by a web server.); 

searching the stored keyword information corresponding to a "object selection information" sent 
from an information terminal (Paragraphs 0047-0049; 0053; 0062. "Search keyword information related to 
selected object.); 

providing at least one of said identification information and said reference information linked to 
the searched keyword information from said information search device to said information terminal 
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through said computer network, when said there is a keyword information corresponding to said second 
information (Paragraphs 0049-0050; 0053. Display selection information and related links.). 

10. Abrahams teaches of program selection information comprising a set of information including 
"program name" and additional information related to the selection information including "Sony 
Walkman", i.e. examples of first keyword information. Abrahams also teaches of a person or producer 
determining program selection information and identifying objects in a video program (Paragraphs 0059- 
0060), but Abrahams does not teach specifically teach of a first keyword information entered by a user. 
However, It would have been obvious to one of ordinary skill in the art that the person or producer (user) 
taught by Abrahams can enter the first keyword information, i.e. "program name" or "Sony Walkman" in 
the database, which would allow the person or producer to customize and provide unique information for 
the viewer, and use the information for matching with objects. 

1 1 . Abrahams also does not specifically teach of searching keyword information corresponding to a 
second keyword information, which is entered by another user, sent through said computer network in 
said information search terminal. 

Zernik teaches of an interactive television system, wherein a viewer can enter search query in the 
form of text to the Internet (computer network) (Paragraphs 0040; 0076) and matching the query to 
keywords on a web page (Paragraph 0063). 

12. It would have been obvious to one of ordinary skill in the art at the time the invention was made 
to combine the teachings of Abrahams and Zernik for the viewer to enter a search query, send the search 
query to the Internet, and match the query to keywords, which would allow the viewer to conveniently 
retrieve additional information regarding a program (Paragraph 0076). 
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13. As per claims 12 and 21, Abrahams teaches the system for providing information as recited in 
claim 10, wherein said database further receives second identification information from said information 
viewing device (Paragraphs 0046-0047. Object selection.), and said database further performs a second 
matching process to match said first identification information from said information registering device 
and said second identification information from said information viewing, and sends said first reference 
information linked to said first identification information and said first keyword information according to 
a result of said second matching process to said information viewing device through said computer 
network (Fig. 3-4; Paragraphs 0049-0050. Provides URL links and keyword, e.g Sony Walkman.). 

14. As per claims 15 and 24, Abrahams teaches the system for providing information as recited in 
claim 10, wherein said database comprises: 

a keyword table which has at least an ID field for uniquely identifying a record entry and a 
keyword field to contain the first keyword, wherein one record entry includes at least its ID and a 
keyword (Figs. 3-4; Paragraphs 0049-0050; 0053. Keyword corresponds to program selection information 
and related links.); 

a reference information table which has at least an ID field for uniquely identifying a record 
entry, a reference information field containing the first reference information, and a keyword ID field to 
containing the keyword ID associated with the reference information, wherein one record entry includes 
at least its ID, reference information, and the associated keyword ID (Paragraph 0049-0050; 0053. Links 
correspond to keyword objects.); 

a target image object table which has at least an ID field for uniquely identifying a record entry, a 
time and frame field containing information to identify media information, and an link ID field containing 
the ID of reference information linked with the object, wherein one record entry includes at least its ID, 
media information, and the ID of reference information linked with the object (Paragraph 0047; 0050; 



Application/Control Number: 10/073,972 Page 8 

Art Unit: 2154 

0053. Selection information comprises time and frame information. Identification information is linked 
with related links.). 

15. Claims 1 1, 16, 20, and 25 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Abrahams and Zernik, in view of Arsenault et al, US Patent #6,925,650 (Arsenault hereinafter). 

16. As per claims 1 1 and 20, Abrahams does not specifically teach the system for providing 
information, wherein said database sends a stored keyword list prior to receiving said second keyword 
information from said information viewing device in response to inquiry made from said information 
viewing device. 

Arsenault teaches of sending a stored keyword list prior to receiving a second keyword from the 
viewer in response to inquiry made from the viewer (col. 11, line 64 -col. 12, line 1 1; col. 16, lines 55- 
65; col. 17, lines 11-31). 

17. It would have been obvious to one of ordinary skill in the art at the time the invention was made 
to combine the teachings of Abrahams, Zernik, and Arsenault to send a stored keyword list prior to 
receiving a second keyword from the viewer in response to inquiry made from the viewer. Arsenault's 
teachings would enhance the user-friendliness of the system by allowing the viewer to efficiently select 
possible keywords to identify objects of interest. 

1 8. As per claims 16 and 25, Abrahams teaches the system for providing information, wherein: said 
content rendered by media-is video image information "distributed By TV broadcasting (paragraph 0025; 
0057. TV broadcast.); said first keyword information includes at least any of a keyword, keyword ID 
number, keyword type, specified time length, time when the keyword was registered, and a number of 
times the keyword has been selected as user preference (fig. 3-4; paragraph 0049. Keyword.); and said 
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reference information includes a URL (Uniform Resource Locator) that designates a Web site/page on the 
Internet (paragraphs 0050; 0053. URL.). However, Abrahams does not specifically teach said first 
identification information further includes at least any of a broadcasting channel over which the content 
was or will be broadcasted, receiving area, specified time length. 

Arsenault teaches of identification information comprising of broadcasting channel and time 
length (col. 8, lines 18-34; col. 15, lines 35-58). 

19. It would have been obvious to one of ordinary skill in the art at the time the invention was made 
to combine the teachings of Abrahams, Zernik, and Arsenault for identification information to comprise 
broadcasting channel and time length, which would by provide the viewer with additional information 
related to the content of interest. 

20. Claims 13 and 22 are rejected under 35 U.S.C. 103(a) as being unpatentable over Abrahams and 
Zernik, in view of Wu et al, US Patent #6,326,982 (Wu hereinafter). 

21 . As per claims 13 and 22, Abraham teaches of sending said first reference information linked to 
said first identification information and said first keyword information according to a result of said third 
matching process to said information viewing device through said computer network (Fig. 3-4; 
Paragraphs 0049-0050.). Abrahams does not specifically teach wherein said database further receives 
second reference information from said information viewing device; said database further performs a 
third matching process to match URLs or comments respectively included in the first and second 
reference information - 

Wu teaches of matching URLs associated with television programming and providing 
information related to the URLs (Abstract; col. 2, lines 52-65; col. 7, lines 21-40). 
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22. It would have been obvious to one of ordinary skill in the art at the time the invention was made 
to combine the teachings of Abrahams, Arsenault, and Wu to match URLs and provide information 
related to URLS, which would provide alternative methods for viewers to identify and receive 
information regarding objects of interest, and in this case, accessing predetermined web pages through 
URL matching. 

23. Claims 14 and 23 are rejected under 35 U.S.C. 103(a) as being unpatentable over Abrahams and 
Zefnik, in view of Rekimoto, US Patent #6,636,249 (Rekimoto hereinafter). 

24. As per claims 14 and 23, Abrahams and Zernik taught the system for providing information as 
recited in claim 10, wherein said first matching process in said database has a process for determining: 
whether one keyword from the first keyword information and the other keyword from the second 
keyword information match or are duplicates. However, Abrahams does not specifically teach whether 
time length associated with the first keyword information and time length associated with the second 
keyword information match or are duplicates in addition to determining whether one keyword from the 
first keyword information and the other keyword from the second keyword information match or are 
duplicates; or whether a time when the first keyword information was registered falls within a time length 
associated with the second keyword information in addition to determining whether one keyword from 
the first keyword information and the other keyword from the second keyword information match or are 
duplicates. 

Rekimoto teaches of searching and matching keywords based on time length from the first and- 
second keyword information (col. 20, line 66 - col. 21, line 1 1). 

25. It would have been obvious to one of ordinary skill in the art at the time the invention was made 
to combine the teachings of Abrahams, Zernik, and Rekimoto to provide matching keywords based on the 
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keyword and time length because both Abrahams and Zernik deal with identify objects in a television 
program. Rekimoto's teachings would enhance the system of Abraham and Zernik by providing 
additional matching criteria, which would provide results that are more accurate and specific to viewers' 
requests. 

Conclusion 

26. Applicant's amendment necessitated the new ground(s) of rejection presented in this Office 
action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). Applicant is 
reminded of the extension of time policy as set forth in 37 CFR 1.136(a). 

27. A shortened statutory period for reply to this final action is set to expire THREE MONTHS from 
the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing 
date of this final action and the advisory action is not mailed until after the end of the THREE-MONTH 
shortened statutory period, then the shortened statutory period will expire on the date the advisory action 
is mailed, and any extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later than SIX 
MONTHS from the date of this final action. 

28. Any inquiry concerning this communication or earlier communications from the examiner should 
be directed to Joshua Joo whose telephone number is 571 272-3966. The examiner can normally be 
reached on Monday to Friday 7 to 4. 

29. If attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, 
Nathan J. Flynn can be reached on 571 272-1915. The fax phone number for the organization where this 
application or proceeding is assigned is 571-273-8300. 
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30. Information regarding the status of an application may be obtained from the Patent Application 
Information Retrieval (PAIR) system. Status information for published applications may be obtained 
from either Private PAIR or Public PAIR. Status information for unpublished applications is available 
through Private PAIR only. For more information about the PAIR system, see http://pair- 
direct.uspto.gov. Should you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 

March 29, 2007 
JJ 




